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Abstract 

We study singular stochastic control of a two dimensional stochastic dif- 
ferential equation, where the first component is linear with random and 
unbounded coefficients. We derive existence of an optimal relaxed control 
and necessary conditions for optimality in the form of a mixed relaxed- 
singular maximum principle in a global form. A motivating example is 
given in the form of an optimal investment and consumption problem 
with transaction costs, where we consider a portfolio with a continuum 
of bonds and where the portfolio weights are modeled as measure- valued 
processes on the set of times to maturity. 
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1 Introduction 

The objective of this paper is to derive necessary conditions for optimality in 
mixed relaxed-singular stochastic control problems. That is, the control has two 
parts: one absolutely continuous and one singular. The relaxation is performed 
by replacing the absolutely continuous control with a control that takes values 
on the set of probability measures. The state process is a solution to a two 
dimensional stochastic differential equation (SDE). The first component is a 
linear SDE whose coefficients are random and not necessarily bounded. The 
second component is a general non-linear SDE whose coefficients have bounded 
derivatives. 

A motivating example is the following optimal consumption-investment prob- 
lem. We consider a market with two investment opportunities, a stock and a 
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portfolio of bonds. The bonds are non-defaultable, i.e. financial contracts that 
are bought today and pay a fixed amount at some future time, called the ma- 
turity time. At each time t, the investor is allowed to buy bonds with any time 
to maturity in [/, where t7 is a subset of M+. The relative portfolio weights 
are therefore modeled as a probability measure on U, reflecting the proportion 
invested in bonds with different maturities. Modeling the prices of the bonds as 
SDEs, we may write down the value xt of the bondportfolio as an SDE of the 
form (see Section [S] below) 

Xt=Xo+ Xs (r° - Vs{u)lds) Qs {du)ds + Xs Vs (u) Qs (du) dB^ , 
Jo Ju Jo Ju 

where Xq is the initial capital, is a Brownian motion and qt is a probability 
measure on U. Further, r° is the short rate, Vt is the integrated volatility process 
of the bond prices and Qt is the so called market price of risk. 

The price of a share of a stock is modeled as a geometric Brownian motion and 
the value of the investment in the stock at time t is then given by 

t nt 



yt^Vo+ / Ay^ds + / pVsdB'^, 
Jo Jo 



where t/o is the initial capital, A and p are constants and B^ is a Brownian 
motion independent of Bf. Note that the prices of bonds and the stock are 
modeled under the physical measure and not under the so-called risk neutral 
probability measure. 

Denoting throughout the paper 

ft (gt) = / ft {u)qt {du) 

JU 

for any function i— > ipt{u), the position at time t for an investor with 
these two investment possibilities is {xt,yt) given by 



Xt =Xo + f (r° - Vs (qs) Os - Cs) ds + f x^v^ (q,) dB^ + (1 - Ki) - , 
Jo Jo 

yt =2/0 + xysds + f pyABy - + (1 - K2) a, 

Jo Jo 

where the consumption process Ct is required to take values in some compact sub- 
set of R+ and = (ff , ) is nondecreasing and left continuous with right limits. 
The value of the bonds sold to buy stocks is recorded by , and records the 
value of the stocks sold to buy bonds. The constants < Ki, K2 < 1 account 
for the proportional transaction costs incurred whenever money is moved be- 
tween the stock and the bonds. The position in the stock, yt, is independent of 
the absolutely continuous control, reflecting a buy-and-hold strategy, while the 
strategy in the bond market involves continuous rebalancing of the portfolio. 
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The objective of the investor is then to choose a consumption/investment strat- 
egy to minimize some cost functional 




■ T pT 



Ji^^,iO^^\ h{t,Xt,yt,IJ,t,Ct)dt+ ktd^t+ g{xT,yT)] , (1-1) 



That is, the objective is to optimally choose three adapted processes {ct,qt,£,t) 
such that (|l.ip is minimized. 

This is an example of a singular stochastic control problem with some non 
standard characteristics. Firstly, the state process is a linear SDE with random 
coefficients, and where r° and 9t cannot in general be assumed to be bounded. 
Secondly, the absolutely continuous part of the control is extended from the 
action space U to the space P{U) of probability measures on U. 

This motivates us to study control problems of the form 



Xt =Xo + 



/ 6'^(s,Xs,Mt)ds+ / o-^(s,x,,/it)dB, + / G^d^, 
Jo Jo JO 

/ ay{s,ys)dBs+ I Gld^s. 
Jo Jo 



yt =2/0 + by {s,ys)ds 
Jo 

The control is a process fit taking values in the space of probability measures on 
the action space U and a nondecreasing process ^t, left continuous with limits 
on the right. Bt is a d-dimensional Brownian motion, xq denotes the initial 
state, and are random coefficients of the form 

6^ {t, X, U, LO) = Vt {u, Uj) + 4>t (u, LU) X, 
cr^ {t, X, u, uj) = Xt {u, w) + ipt {u, Uj) X, 

for given stochastic processes w, x £^i^d ip taking values in the space of con- 
tinuous functions on U. Further, 6^ and cr^ are deterministic functions and the 
cost functional, which is to be minimized, is of the form 

J{pt,^t)^^^J h{t,Xt,yt,tJ't)dt + J ktdS,t + g{xT,yT)^ ■ 

This paper contains two main results. The first one, Theorem l3.1[ establishes ex- 
istence of an optimal relaxed control which is derived using a similar scheme as in 
Andersson and Djehiche(2007)| . The main tools in the proof are tightness and 



Skorohod's selection theorem. The second main result. Theorem 14. 2[ suggests 
necessary conditions for optimality that are given in form of a relaxed maxi- 
mum principle. We follow the scheme in [Bahlali and Mezerdi(2005)] , where a 
stochastic maximum principle of second order type (i.e. two adjoint processes) 
is obtained by performing a spike perturbation on the absolutely continuous 
control. However, by only considering relaxed controls, i.e. extending the con- 
trol to the space of probability measures on the action space, V{U), which is 
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a convexification of the action space, it allows us to use a convex perturbation 
although the action space is not convex. Ultimately this leads to a maximum 
principle in global form, i.e. just one adjoint process. 

Under the usual assumptions on the coefficients in the SDE, i.e. deterministic 
functions of {t,x,u), Lipschitz continuous and with linear growth in x, a maxi- 
mum principle for stochastic (strict) control problems where the control enters 
the diffusion coefficient and the control set is not convex was established in 
Peng(1990)| . Since the action space is not convex, a spike perturbation method 



was applied which led to a second order maximum principle. 
As for singular stochastic control problems, they have been studied by many 



authors, see Haussmann and Suo(1995)] and the references therein. These pa- 



pers mainly focus on the dynamic programming principle. The first stochastic 
maximum principle for singular control problems is obtained in 
Cadenillas and Haussmann(1994)| , where they assume linear dynamics with 



random but bounded coefficients, convex cost criterion and convex state con- 
straint. In Bahlali et al.(2007)] the maximum principle is extended to include 



relaxed controls, under the assumption that the diffusion coefficient is indepen- 
dent of the control. 

The paper is organized as follows. In Section[2l we formulate the mixed relaxed- 
singular control problem for our linear SDEs. In Section [3] we prove existence of 
an optimal control, while in Section |4l necessary conditions for optimality are 
given in form of a relaxed maximum principle. In Section [5l we apply these re- 
sults to formulate a maximum principle for the optimal investment/consumption 
problem. 

2 Formulation of the problem 

Let r > be a fixed time horizon and (il, Tt, P) be a filtered probability space 
satisfying the usual conditions, on which a d— dimensional Brownian motion 
{Bt}t^[o T] defined. We assume that {J-'t)f.^[Q is the natural filtration of Bt 
augmented by P— null sets of T. 

Consider the following sets, U is a compact subset of R'' and A = ([0,00))"^. 
Let U the class of measurable, adapted processes u : [0, T] x 51 — > U and A 
the class of measurable, adapted processes ^ : [0, T] x — > A such that ^ is of 
bounded variation, nondecreasing left continuous with right limits, ^0 = and 
E I^tT < 0° foi' ^'^y P ^ ^■ 

We define a two dimensional controlled SDE on (il, Tt,^), with absolutely 
continuous control ut and singular control £,t : 

Xt=Xo+ [ b"" {s,Xs,Us)ds + [ a"" {s,Xs,Us)dBs+ [ Gfd^,, (2.1a) 
Jo ^0 ^0 

yt^yo+ f by{s,ys)ds+ f ay{s,ys)dBs+ f G^d^. (2.1b) 
Jo Jo Jo 
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where {xq, yo) £ is the initial state, G?^, : [0, T] ^ R'^, by : [0,T] xR ^ M. 
and a-y : [0, T] x R M'^. Furthermore, the coefRcients and cr^ are given by 

b^ {t, a;, u, u) = vt (u, o^) + 4>t (u, o^) x (2.2a) 
cr^ (t, x, u, u) = xt (", t^) + (", ^) a;, (2.2b) 

where u : [0, T] x [/ x i-^ R, : [0, T] x t/ x 17 i-^ R, X : [0, T] x [/ x r2 R'' 
and : [0, T] X [/ X 1-^ R'^ are .Ft-adapted processes. 

The cost functional is given by 

J (m, ^)^e(^J^ h (t, xt, yt, ut) dt + ^ fctd^t + g (xT, yr) j , (2.3) 

and the objective is to minimize J over the set of admissible controls. A control 
(m*, ^*) is called optimal if it satisfies J (u*, ^*) = inf{ J {u,£_) lu eU,£, e A}. If 
also (u*,^*) G X it is called a strict optimal control. 

This kind of control problems is often formulated in the so-called relaxed form, 
due to the fact that a strict optimal control may fail to exist (see e.g. 
Bahlah et al.(2006)| and |Lou(2008)| ). Instead one embeds the strict controls 
in a wider class of controls that takes values in probability measures on U rather 
than on U itself. Also, a solution to a relaxed control problem is a weak one, 
i.e. the probability space, equipped with the a priori given stochastic processes, 
is part of the solution. 

Let ViU) be the space of probability measures on U. If /it(dM) is a stochastic 
process taking values in V^U), we denote by £([0, T],U) the space of the (Radon) 
measure- valued processes dXt{u) — ^t{du)dt. If a probability space {il.,J^,F) is 
given, then we denote M{n) the space of all J^t-adapted processes ^t(du) taking 
values in V{U). Further, we denote by L{n) the space of all £([0, T], J7)-valued 
^(-adapted processes. It can be shown that there is a one-to-one correspondence 
between M{Q) and L(yi), and that jC([0,T], U) is a compact metric space. For 
further discussion, see [Ma and Yong(1995)| . 

By expanding the set of controls from U to 7W, the state equation is defined as 

xt=xo+ [ 6^(s,X5,/is)ds-f- / a"" {s,Xs,fis)dBs + [ G^d^^, (2.4a) 
Jo Jo Jo 

yt =2/0 + by (s, y,) ds + f ay {s, y,) dB, + f G^d^,. (2.4b) 
Jo Jo Jo 

We make the following assumptions regarding the state equation and the cost 
functional. 

(A.l) Lpt {u,Lo) is continuous in {t,u), where ip stands for one of the processes 
(A. 2) ^ is uniformly bounded in R+ x U x fl. 
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(A. 3) For any p £ (—00, 00), it holds that 



supE I exp \ p I 0t (u) ) ) < cx). 



(A. 4) For any p > 1, it holds that 

supE I / \vt {u) l^dt I < 00 and supE ( / 
iie(7 \Jo j ueu yjo 



\Xt (u) \Pdt < 00. 



(A. 5) The functions by^cr^ are continuously difFerentiable in y with bounded 
derivatives. The functions G^, are positive, continuous and bounded. 

(A. 6) The functions g and h are continuously differentiable in {x,y). The func- 
tion g and its derivative are bounded and Lipschitz continuous in {x,y). 
The function h and its derivative are bounded, continuous in u and Lips- 
chitz continuous in {x,y). The function k is continuous and bounded. 

Remark 2.1. Assumption {A.6) is made here out of convenience. It is possible 
to consider h and g that are only Lipschitz continuous in {x,y), without any 
assumption about differentiability. See jBahlali et al.(2008)^ . 

Definition 2.1. A relaxed control is the term A = (fi, ^t, Bt, pt, Xt, yt, (.t), 
where 

(i) (Q, J-t,P) is a filtered probability space; 

(a) Bt = {Bt,Vt,4>tTXtT4't), in which {Bt} is a d-dimensional J-f-Brownian 
motion and Vt, 4>t,Xt, i't are J-'t-adapted stochastic processes satisfying (A.l)- 
(A.4); 

{Hi) e M{n), G A; 

(iv) (xt,yt) is Tt-adapted and satisfies (j2.4p . 

We denote by TZ the set of all relaxed controls. The cost functional corresponding 
to the control A is defined as 

J{A)=¥.(^J^ h{t,xt,yt,Pt)dt + j^ktd^t+g{xT,yT)^, (2.5) 

and a relaxed control A* is optimal if J [A*) ~ inf{J(^) \A G TZ}. It is well 
known that lA may be embedded into TZ, since any strict (t/- valued) control 
process ut can be represented as a relaxed control by setting /if(du) = 5u^{du). 

Throughout the rest of the paper we will not specify that properties hold P-a.s. 
when it is clear from the context. Further, we denote for any process ipt^ 

= sup \iptY'. 
te[o,T] 
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3 Existence of an optimal control 

In this section we shall establish the existence of an optimal relaxed control. To 
achieve this, we consider a minimizing sequence of controls A^''^ G TZ for the 
cost functional J, i.e. 

M{J{A),AeTZ} = lim J(^('=)), 

k — >oo 

and show that a limit A exists and fulfills (i) — (iv) in Definition 12. II The main 
tools are tightness of the processes and Skorohod's Selection Theorem. 

Given a relaxed control A = (fi, J-, .^t, F, Bt, ^t,xt,yt,£.t), there exists a unique 
strong solution to the equation given by (|2.2p and (|2.4p . Moreover, with the 
assumptions (A.1)-(A.5) we can prove by standard methods that (xt, yt) has the 
following properties: For any p > 1 we have 

^\x.\*r^^ +^\y.\*j,'^ <oo. (3.1) 



We endow the space A with the pseudopath topology, cf. Haussmann and Suo(1995)] 



The pseudopath identifies two functions if and only if they are equal (Lebesgue) 
almost everywhere. Under the pseudopath topology, ^ is a seperable metric 
space and convergence in the pseudopath topology is just convergence in mea- 
sure, i.e. for f", ^ G .4, ^" ^ ^ if and only if 

^/(t)d?r- r f{t)d^t (3.2) 



for any / £ C([0,r],R^). 

Let = (r!W,.F('^-),P('=),.f-f\Bf\/if\a;f\yr\d'^) be a minimizing se- 
quence, i.e. 

J(^"=^) ^inf{J(^);^ei^^}, asfc^oo. 
We will derive tightness for this sequence. First, we introduce the notation 

Jo J A 

for any Borel set Act/, and define the continuous processes 

™f)(x)=xf)- Tc^dC?), 
Jo 







Lemma 3.1. The sequence {b[''\ \[''\m{x)[''\m{y)['^\ ^f'^'') is tight in 
(C([0,T]) X C([0,T] X [/)4) X C{[0,T] x U) x C{[0,T]) x C([0,r]) x A. 
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Proof. ^ is tight since the processes induce the same measure for every k. 
Also, A('^^ is tight because C{[0,T] x U) is compact. Moreover, by (A.1)-(A.5), 
it is readily seen that there exists a constants Ki, K2 > such that 

E(''Hm{x)[^^ - m{x)i''^)^ < Ki\s - t\^, 
m{m{yp ~m{y)i'^^f<K2\s^t\', 

for all t,s £ [0, T], for all k, where E'^'^^ is the expectation under P^*^). Hence 
the Kolmogorov condition is fulfilled (see e.g. Yong and Zhou(1999)| , Theorem 
2.14.) and (mix)'l'\ m{y)['"^^ is tight. 

As for the tightness of , we proceed as in Haussmann and Suo(1995)] and 
define the set 

Vm e A'' : \^t\ < M} . 

Vm is then compact for any constant M > 0. Further, define 

^{AeU: J{A) < A} , 

where A is chosen so that TZ'^ is nonempty. Obviously we can restrict the mini- 
mizing sequence to TZ^. It also holds that 

lim inf P(|^t| < M) = 1, 



see 



Haussmann and Suo(1995)] , Proposition 3.4. Thus, for any given e > 



there exists a compact set Vm such that for all P^*^^ , ^j'^'* G TZ 



^'"'^ e 14/ ) > 1 - e. 



(k) 

Thus, the sequence Q is tight. ■ 

Theorem 3.1. Under the assumptions {A.1) — {A.6), the relaxed control problem 
admits an optimal solution. 

Proof. By Lemma [3TT| the sequence {b[''\ x[''\ m{x)[''\ m{y)[''\ ^'^''^ ) is tight 
and thus by Skorohod's selection theorem, there exists a probability space 

{Cl, JF, P), on which is defined a sequence of processes {b[ \ X^^\rn{x)^^^\rri{y)^^\s^^'') 
identical in law to (sj'^'' , aI*^"* , m(a;)|'^'' , to(?/)|'^\ ^j*^-*) and converging P-a.s. to 
{Bt,\t,m{x)t,m{y)t,it)- 

Moreover, as in [Andersson and Djehiche(2007)| , Lemma 3.1 we may assume 
that has continuous paths for each Borel set A. Thus, by Lemma 2.1 

Ma and Yong(1995)| the processes /tj'^'' corresponding to A^'^'' have the same 



law as fif^ since fji'l''' has continuous paths 
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We have then shown that there exists a hmit A of the minimizing sequence A^'''> 
which satisfies (i) — (in) in Definition 12.11 It remains to show that (iv) also 
holds. To this end let and be the processes defined by (|2.2p . then we can 
prove as in Ma and Yong(1995)| Lemma 3.3, that 



in iv^([0, T] X fi), as fc ^ oo. Using this result and the fact that 

{Bt , Af\m(i)f \m(y)f MP ^) {Bt,Xt,m{x)t,m{y)t,it) P-a.s., as fc ^ oo, 

we can prove that the limit {xt,yt) of ^xj'^'', y^'^''^ satisfies 



xt ^ xo + / b"" {s,Xs, fis) ds + / a"^ {s,Xs, fis) dBs + / Gfd^s, (3.3) 



yt=yo+ / by{s,y,)d.s+ / ay{s,y,)dB,+ / G^d^, (3.4) 
Jo Jo Jo 

i.e. that 



E 



+E 



x.-xq- / b'-^ {s,Xs,fls)ds - / (f^ (s,Xs,/is)dSs - / G^d^, 



y--yo- / 6Ms,y3)ds- / ^Ms,^,,)dB,- / G^de 



*,2 



= 0. 



As for xt, we note that by p.2p the sequence m(i;)( = — /q GJdQ con- 
verges to m{x)t = Xt — /g GJd^s P-a.s. in G([0, T]) and by uniform integrability 



E 



G^de?) -£.-!-/ G^de 



Further, by applying the same proof as in Andersson and Djehiche(2007)| , The- 
orem 3.1, we can prove that 



(s,iW,Ai'^)ds- f b-{s,Xs,Md 



*,2 



0, and 



as fc ^ cx). Now, since xj'^'' satisfies 



Xl ' = Xq + 
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for every k, we may write 



E 



< E 



X. - xq - / 6^ (s,is, As) ds - / a"" {s,Xs, ils)dBs " / G^d^, 



-E 



-E 



- G^dC, - i^''^ + / Gfd^l'^) 



cr^ (s,is, As) dSs 



The conclusion foUows by letting k — > oo. Similarly (more easily, in fact) we 
can show that yt satisfies p.4p . 

Finally, since /, g and k are continuous and bounded, it is readily seen that 
J(i('=)) =t(ff(s^ xf^ , yO^Kf^) ds + f kAiA 



E 



/(s,is,ys,As)ds + 



^ ksdi}j =J{A). 



Since A.^^'^ is a minimizing sequence , we conclude that 

J (A) = inf JiA) . 

Therefore, A= {fl, J-,P, J-t, Bt, fit,xt,yt,£,t) is an optimal relaxed control. 



4 A relaxed maximum principle 

4.1 Preliminary results 

Let (/X, ^) G 7?. be an optimal control and xt the corresponding state trajectory. 
Since ViU) is a convexification of the action space U we may introduce the 
following convex perturbation of (/i,^). 

^il = fit+0{qt~ fit) , 

for < < 1 and {q,r]) £ TZ. Now, since V{U) is a convex space, it is readily 
seen that (z^^,^^) G TZ. Further, we define 

Ji=j(/,0-J(/,C), 
J2 = J(/,e)-^(A*,0- 
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We will derive the variational inequality from the fact that 

Hm— + lim— >0. (4.1) 

Denote by and (^xf y[" '^^^ the state trajectories corresponding to 

(a*^)^^) S'lid (a**)^) respectively. Note that yf'^ = yt since yt is independent of 

Lemma 4.1. Under assumptions {A.l) — (^.5), we have that for any p>l, 



limE 
UmE 



X — X 



imE ( 
^0 V 



- x' 



0. 



Proof. Define = a;* — x^^'^\ Then A( can be expressed as 



At = ^ (v, - V, (/z,) + (0, (/if) - 0, (/i,))) ds + ^ A,ds 
+ ^ (Xs (Ma) - X« (m«) + (V« (^f ) - (M«))) dS, + V-^ (Ma) A«dB,. 



Let 

Zt = l- (f)s (Ms) 
JO 

Note that by (A. 3) we have that 



z.ds. 



It 
-1 l*.p 



< CXD, 



for any p >1. Next we apply Ito's formula to get 

^tzt = ^ (i^s {ill) - V, (/.,) + (<^, (m^) - (m«))) ^.ds 

+ ^ (xs (m^) - X. (m.) + a:!^'^^ (V-s (m^ ) - -^s (a<«))) -^sdB« + ^ V-^ (m.) A,^,dB, 



Vs ifJ-s) + a;i^'^^ (<?!)s {Qs) - (ps (Ms))) ^sds 

+ j (xa {Qs) - Xs (Ms) + xi*^'^^ {tps {Qs) - tps {iJ-s))) ZgdBs + j (Ms) AsZ^dB^, 

where we also have used the definition of /i^. Since -0 is bounded we can apply 
the Gronwall and Burkholder-Davis-Gundy inequalities to obtain 



E\A.z. < ^ I {i^s (qs) - (m.) + {<t>s (?.) - <Ps (m«))) ^, 

[Xa (qs) - Xa ilJ-a) + xf'^^ {ips {qs) " (M«))) Z. 



ds 
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By using the Holder inequality we can conclude that the integrals on the right 
hand side are finite, and hence 



as 6* ^ 0. 



E\z-^A.z.\y < K 



Next, redefine A as At = x^f'^^ — x^. It holds that 

At = /* A,0, ds + f A,V. dS, + /* G'iA (Cf - 6) 
Jo Jo Jo 

t nt 

Jo 

+ 9 f As {qs (ps) - (jis {iJis)) ds + f As {il^s (qs) - (m^)) dB, 
Jo Jo 
t 



(e|a. 



i*,2p 



1/2 



0, 



e I G:d(77.-6) 

Jo 



Letting 



Zt = 1- (t)s ifJ-s) Zsds, 
Jo 



and applying Ito's formula, yields 

Atzt ^ / Asi/Js ifJ-s) ZsdBs 
Jo 



+ 9 As {(f>s {qs) - 0s {^J's)) Zgds + 9 As {tps (qs) - ips (fJ-s)) ZgdBs 
Jo Jo 

+ 9 f G^sZsd{vs-Cs). 
Jo 

Using that is bounded we apply the Burkholder-Davis-Gundy and Gronwall 
inequalities to obtain 

E \A.z.\*/P < 9^pkI^eJ^ \As {(Ps {qs) - CPs (a^s)) zsl^" ds 

+E f \As {iJs {qs) - i^s {^^s)) zsl^" ds 
Jo 

ZsG:d{r,s~Cs) 

By the Holder inequality the integral on the right hand side is finite, and hence 



E 



x^''^^ - x' 



= E|zr^A.z.|^''' <K{E\A.z. 



I *,2p 



1/2 



0, 



as ^ 0. Finally , the fact that E \ y^^ '^^ — — > as 6* — > is a special case 
of Lemma 3.3 in [BahlaU et al.(2007)| . ■ 
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Lemma 4.2. Under assumptions {A.l) — {A.5), we have 



limE 

6*^0 



*,2 



+ limE 

61^0 



n 



0, 



where 



Jo Jo Jo 

ai=[ by{s,y,)ayds+ [ ay{s,y,)aydB,+ f G^d(%-^,). 
Jo Jo Jo 



Proof. Let 



A, = ^^^^ at 



Then, we may write as 

Jo Jo 



- / <t)s{^i8)a'sds- I '4}s{lJis)oildBs 
Jo Jo 

-of {4>s {Qs) - (Ms)) ot^ds -6 [ {ips (Qs) - A if^s)) <dSs 
Jo Jo 

= / Ag^s (/is) ds+ AsVs (Ms) dBs 
Jo Jo 

+ £ (xf - (0, (g,) - 0, (/z,)) ds + (xf - (^^, (g,) - (m.)) dS, 

~^[J^ (<^s (gs) - </'s (Ms)) ds + ^ (?/;s(gs)- Vs(Ms))asd-Bs|. 
Letting 

Jo 



Zt = l 



\ z.ds. 



13 



and applying Ito's formula as well as the Burkholder-Davis-Gundy and Holder 
inequalities, we get 



ElA.z.lt'^P <kIe I |A,z,pPds 



4p 



^0 

T rT 

2p 



ds 



Jo Jo 



By Lemma 14.11 and the integrability of the last term we can apply Gronwall's 
inequality to conclude that 



E\A.z.\*j;^P 0, 



as ^ 0. Consequently, 



E|A|^'^ =E\zr^A.z.\*^^ <k(e\A.z. 



1/2 



0, 



as 61 ^ 0. 



The second assertion is a special case of Lemma 3.4 in Bahlali et al.(2007)] 



Lemma 4.3. Under assumptions (A.l) — {A.5), we have 



limi 

9^0 



x: — X. 



■ a. 



where. 



Jo Jo 

+ {b'' {s,Xs,lJ,s) -b"" {s,Xs,qs))ds+ {a"" {s,Xs, fJ-s) - <j'' {s,Xs,qs)) dB^ 
Jo Jo 



Proof. We let 
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and rewrite At as 



1 



1 /■* 

+ ^ y (cr'' (s, x^, ) - cr^ (s, a;^, Ms)) dS^ 

^•t ft 

(t)s (Ms) Ads - I ips (^is) AdS^ 
'0 Jo 

(s,a;5, Ms) (5,2^5, gs))ds - / [a"" {s,Xs, ^JLs) - (t"" {s,Xs,qs)) dB^ 



(Ms) /3sds - iIjs (Ms) /?sd-B, 
Jo 

: / (/Is) Asds + ips (Ms) Asdi3s 
Jo Jo 

(g.) - (Ms)) (4''^^ 



Defining 



a;^ j ds 
Xs 1 dSc 



Zt = I- 4>s (Ms) ^^sds, 
Jo 



and applying Ito's formula as well as the Burkholder-Davis-Gundy and Holder 
inequalities, yields 



T I i-T 



E\A.z.\*^'P <K J \A,z,rds+ \ E 
By Gronwall's inequality and Lemma |4. II we have 



4p 



1/2^ 



ds 



E|A.z. 



as — > 0. Finally, by Holder's inequality 



E 



0, 



E\A\*/ ^0, 



as 6* ^ 0. 
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Lemma 4.4. Under Assumptions (A.l) — (A.G), we have 

lim^ = IE(aT5x {xt.Vt) + a^9y [xt^Vt)) 
>0 a 

+ E / {a''^hx{s,Xs,ys,fis) + ayhy{s,Xs,ys,fJ's))ds (4.2) 
Jo 

+ E [ fc,d(?7, -e.). 



Proof. See [Bahlali et al.(2007)| , Lemma 3.5. 



Lemma 4.5. Under Assumptions (AA) — {A.6), we have 

Imy = IE i9x {xt, Vt) Pt) 

+ E hx{s,Xs,ys,fis) Psds (4.3) 
Jo 

+ E / {h{s,Xs,ys,qs) - h{s,Xs,ys,IJ's))ds. 
Jo 



Proof. The proof is similar to that in Peng(1990)| , Lemma 2 



4.2 Variational inequalities and adjoint equations 

We recall the adjoint processes for the state process (12.41) . These are two pairs 
of processes (p^,P^), (p^,P^) with values in R x M'^ defined for any control 
(/i,^) e TZ. We denote by fx the derivative with respect to x of the function /, 
where / stands for either g or h. Then {p^ , P^), {p^ , P^) are given by 

fdpf= ~{^t{iit)p^ +4't{fit)Pr + Kixuyu^it))dt + Pt-dBt ^^^^^ 

1 Pt = gx {xT,yT) 

|dpr= ~{by{t,yt)pt+ay{t,yt)Pf + hy{xuyulJit))dt + pydBt ^^..^ 

1 Pt = 9y {xT, yr) 

Note that the reason for the extra components P^^py is to make it possible 
to find an adapted solutions to these backward SDEs (see Ma and Yong(1999)| 



for further discussion). Next, we introduce the Hamiltonian of the system (see 
e.g. [Bensoussan(1982)] ) : 

H{t,x,y,fi,p,P) = -p(vt in) +<i)t {p)x^ - p{xt (p) +A i^J■)x'j -h{t,x,y,fi) 
for {t,x,y,fi,p,P) e [0,T] X R X R X P{U) x R x M''. 
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Theorem 4.1. (The maximum principle in integral form) 
Let {HiC} GTI be an optimal relaxed control, i.e 

{q,ri)eTZ 

and let {xt,yt) be the corresponding trajectory. Then the following inequality 
holds. 

<E r ih + Gl -p^.+Gl- p\) d{7j - Ot 
Jo 

+ E [ iH{t,xt,yt,fit,PhPn-H{t,xt,yt,qt,P^,Pn)dt, (4.6) 
Jo 

for all {q, rj) G TZ. 
Proof. Define 

$(a;)t = l+ / (j)s{Hs)Hx)sds+ f ipsitJ-s)Hx)sdBs, 
Jo Jo 

$(y)t = l+ fbl{s,ys)<^{y)sds+ /* (s, y,) $(2/),dB, 
Jo Jo 

By Ito's formula $(a;)~^, are given by 

$(x),-i = 1+1 {^J{ns)Mi^s) - Mi^s))^x);'ds - [ Ml^sMx)j'dB„ 
Jo Jo 

^y)^' = 1+ f [ol (s, y,)^ al (s, y«) - 6^ (s, y,) ) ^{y)-^ds - f ay {s, y^) $(y) 
Jo Jo 

By a simple manipulation we deduce the moment property 

E|$(x). i;,'^ + E|$(.T)r' It'" < 00, (4.7a) 
E|$(y),|;'f +E|$(2/)r^i;'^ < 00, (4.7b) 

for anyp > 1. Next, we introduce 

X = ^{x)Tgx{xT,yT) + I ^{x)thx{t,xt,yt,Ht)dt, 







Y = ^{y)Tgy{xT,yT)+ / ^{y)thy{t,xt,yt,Ht)dt, 
Jo 

Xt = E(X|.Ft) - / ^{x)sha,{s,Xs,ys,l^s)ds, 
Jo 

Yt=¥.{Y\Tt) - / ^{y)shy{s,Xs,ys,IJ's)ds. 
Jo 
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Since and hx are bounded we can use l|4.7p to deduce that 

E|X|^ + E|r|'' < oo, 

for any p > 1. Thus, by the martingale representatfon theorem (cf. [Karatzas and Shreve(199"8)] , 
Theorem 4.2) there exist JT^-adapted processes H'f , Hf with the property that, 
for any p>l, 



EU^ \Hn^At\ +eU^ \Hn^dt\ <oo, 



and such that 



Xt = E{X) + [ H^dB, 
Jo 

Yt = E(y) + / nydsy 

Jq 







t 

t 



We may now define our adjoint processes (p^, P^) , {p^, P^) as 

P: = <^{x)i'H^-Ml^t)ph 
p\ = <^{y)i^Y^, 

pf ^mi'Hy~ay{t,yt)p\, 

noting that [pf ) and Pi (Pt) are M- resp. R'^-valued JT^-adapted processes 
satisfying 



E\p.\*tP + eIJ^ iP.pdij 



\ P/2 

< OO, 



for any p > 1. Applying Ito's formula on pf = ^{x)^ ^Xt and p\ = ^{y)t ^Yt 
yields 

dp^t = -[K{t,xuyu fit) + PtMf^t) + PtMpt))dt + P,-dBu (4.8) 
dpy = - (hy{t, xt,yt,fit) + p\bl {t, yt) + P^al {t, yt) )dt + dS^. (4.9) 
Using (|4.8p . and once again by using Ito's formula we can derive 



^{ptXt) =E (pti'^tiPt) + <l>t{pt)xt ~ i^tM ~ Mf^t)xt) 

+ Pt{xt{f4) + '>Pt{fJ-t)xt - XtifJ-t) - ■)pt{p-t)xt) - K{t,xt,yt.,fit)Ptjdt. 
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Thus, we can rewrite (|4.3p as 

lim^=E / iHit,xt,yt,qt,PlPn-Hit,xt,yufiuPlPn)dt. 
Smiilarly, by applying Ito's formula to pfaf + p^a^ we may rewrite (|4.2p as 

lim^ =E r ih + G^ + G^ py) d (77, - 6) . 
Finally, by combining these equalities with inequality (|4.ip the result follows. ■ 

4.3 Necessary optimality conditions for relaxed controls 

Theorem 4.2. (The relaxed maximum principle) 

Let (/i,^) be an optimal relaxed control and (xt,yt) the corresponding optimal 
trajectory, then 

H{t,xt,yt,tJ-t,Pt,Ptl^ sup H{t,xt,yt,qt,Pt,Pn, a.e.,P-a.s, (4.10) 

qev{u) 

P (Vt e [0, T], Vz ; + G^Wpt + Sf) > o) = 1, (4.11) 

P fEl{.«+Gr<S?+GfS?>o}de - 1. (4.12) 



Proof. Using the proof in Cadenillas and Haussmann(1994)| , Theorem 4.2, 



this result can be shown to follow from the maximum principle in integral form 
(Theorem |4T|) . ■ 



5 A financial application 

In this section we give a financial application of the derived stochastic max- 
imum principle. We consider an investor on a market with two investment 
opportunities, a stock and a portfolio of bonds. The assets in the bond mar- 
ket are non-defaultable bonds, i.e. financial contracts that are bought today 
and pay a fixed amount at some future time, called the maturity time. At 
each time t, the investor is allowed to buy bonds with any time to maturity in 
U, where J7 is a compact subset of R+. The dynamics of the bond prices are 
given by the Heath- Jarrow-Morton model with Musiela parametrization (see 



Andersson and Djehichc(2007)J: 



dpt{u) = pt{u) (r° - rt{u) - vt{u)Qt) dt + pt{u)vt{u)dB^ . (5.1) 
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Here Bf is a Brownian motion, vt is the integrated volatility process, Qt is the 
so-called market price of risk, rt {u) is the forward interest rate and is the 
short rate. 

Investing in bonds with the price dynamics as above gives the opportunity to, 
at any time, choose among a continuum of assets, and therefore we consider 
measure-valued portfolios. More specifically, we let qt € M denote the relative 
portfolio weights. Then the value of the investment in the bond market can be 
derived (see Andersson and Djehiche(2007)| ) as an SDE of the form 



Xt = Xo + 



Jo Jo 



where a;o is the initial capital. 

The price of a share of a stock is modeled as a geometric Brownian motion and 
the value of the investment in the stock at time t is then given by 

yt=Vo+ / Aysds + / pVsdB^, 



where Bf is Brownian motion independent of _Bf , j/o is the initial capital and A 
and p are constants. 

The investor can choose between investing in the bond market, the stock or to 
consume. The investors position at time t is {xt,yt) where 





yt ^yo 



Xt =Xq + / Xs (r° - Vs (qs) Os - Cs) ds + / XsVs (qs) dB^ + (1 - Ki) - , 

JQ Jo 

f \ysds + /* pvsdBi - + (1 - K^) e?. 

Jo Jo 



The objective of the investor is to choose a consumption/investment strat- 
egy consisting of three adapted processes {ct,qt,£,t)- The consumption process 
is required to take values in some compact subset of M+. = (Cf j^f) is non- 
decreasing and left continuous with right limits. The value of the bonds sold to 
buy stocks is recorded by and <^f records the value of the stocks sold to buy 
bonds. The constants < Ki^K2 < 1 account for the proportional transac- 
tion costs incurred whenever money is moved between the stock and the bond 
market. 

Assuming that our goal is to minimize a cost functional of the form 
Jiq,c,^)=E\ / h(t,xt,yt,qt,ct)dt + g{xT,yT)] , 
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we get an optimal control problem on the form (|2.2p . (|2.4p . (l2.5p . with 



Ht^qt"^ Set ) 

ivt{-),Mu,c),xti-),Mu)) = (0, {r"^~vt{u)et - c) ,0,vtiu)) , 
{by{;y),ay{;y)) = {\y,py), 

G- = ((1-Xi),-1), 

5.1 Optimal investment and consumption with transac- 
tion costs 

We consider the following cost functional. 

supE ( / e-^V (ct) dt + g (xt, ?/t) ) • (5.2) 

Assume further that {qt,ct,^t) with corresponding portfolio {xt,yt) is optimal. 
Using the relaxed maximum principle we may write down the necessary condi- 
tions. The adjoint equations becomes 

dp^ = - {{r° - Vtiqt)Qt ~ Ct) p- + vt (qt) P^) dt + Pf di?f 
Pt = 9x{xT,yT) 

dpy^ ^i\py + ppy)dt + pydBy 

Pt^ 9v{xT,yT) 

Remark 5.1. The adjoint processes corresponding to standard interest rate 
model are quite involved and it is difficult to find explicit solutions and therefore 
difficult to solve this kind of investment/ consumption problem explicitly. We 
refer to \Lou(2008)^ for some worked-out examples of optimal relaxed controls 
and to I0ksendal and Sulem(2005]^ for some examples on how to find optimal 
singular controls. 

Moreover, the corresponding Hamiltonian is given by 
H{t,Xt,qt,Ct,Pt,Pt) = 

-p^ (r° - Vtiqt)et - Ct) xt - Pt'vt{qt)xt - e-f^'f{ct). (5.3) 

The function vt corresponds to different interest rate processes. Choosing the 
volatility process to be constant, i.e. choosing the Ho-Lee model, 

at{u) = (T, 

and consequently 

vt{u) = -an, 
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the short rate r° is a Gaussian process. Under a obvious integrabihty assumption 
on Qt we then have that (A.1)-(A.3) are fulfilled. Thus by the relaxed maximum 
principle, the necessary conditions for the optimality of {qt,ct) is that they 
maximize (15.31) with 

vt{qt) ^ -o- / uqt{du). 
Ju 

Moreover, the optimal time points of transfer between the bond market and the 
stock is given by the following. 

IP (l{(i-Ki)p?-Pt">o}d^r + +(i-K2)Pt">o}dCl' = O) = 1. 

Another choice of volatility process that induces a mean-reverting Gaussian 
short rate is 

(Tt{u) = ere"™, 

with constants cr and c. This is the Hull- White model. Similarly, the necessary 
conditions for optimality is given as above, with 

vtiqt)^- I (e-™-l)gt(dz.). 
c Ju 
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